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AMENDMENTS TO THE CLAIMS 

Please amend the claims as shown below, with insertions indicated by underlining and 
deletions indicated by strikethrough and/or double brackets. 

1 . (Currently Amended) A method of evaluating grammars associated with a voice portal on a 
portal server, said method comprising: 

generating, for a current grammar of the voice portal representing a valid input for a first 
menu of the voice portal, a test input, the test input for the current grammar including a test pattern; 

providing the test input to the voice portal on the portal server using a voice server; 

receiving at least one measure of how distinguishable the current grammar is from other 
grammars of a set of active grammars that are active when the current grammar is active, the set of 
active grammars including the current grammar and at least one grammar from a second menu of 
the voice portal, the at least one measure based at least in part on analysis of the test pattern with 
respect to the set of active grammars , the at least one measure comprising a t least one measure of 
how distinguishable the current grammar is from the at least one grammar from the second menu of 
the voice portal ; and 

determining whether to modify the current grammar based at least in part on the at least one 
measure. 

2. (Previously presented) The method of claim 1 , wherein the at least one measure of how 
distinguishable the current grammar is from other grammars of the set of active grammars includes 
a confidence level and a set of n-best results for the test input, and wherein the method further 
comprises comparing the confidence level and set of n-best results for the test input with an 
expected value to assess the at least one measure of how distinguishable the current grammar is 
from other grammars of the set of active grammars. 

3 . (Previously presented) The method of claim 1 , further comprising modifying the current 
grammar to create a modified grammar if the at least one measure indicates that the current 
grammar is not sufficiently distinguishable from the other grammars of the set of active grammars. 
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4. (Previously presented) The method of claim 3, further comprising: 

(i) generating a test input for the modified grammar, the test input including a test pattern 
for the modified grammar; 

(ii) providing the test input for the modified grammar to the voice portal on the portal 
server using the voice server; 

(iii) receiving at least one measure of how distinguishable the modified grammar is from 
other grammars of a set of active grammars that are active when the modified grammar is active, the 
modified grammar being one grammar of the set of active grammars that are active when the 
modified grammar is active; and 

(iv) modifying the modified grammar and repeating steps (i) through (iii) until the at least 
one measure of how distinguishable the modified grammar is from other grammars of the set of 
active grammars that are active when the modified grammar is active indicates that the modified 
grammar is sufficiently distinguishable from the other grammars of the set of active grammars that 
are active when the modified grammar is active. 

5 . (Previously presented) The method of claim 1 , further comprising modifying the test pattern 
to emulate one or more user voices prior to providing the test input to the voice portal. 

6. (Previously presented) The method of claim 1 , further comprising modifying the test pattern 
to emulate the influence of one or more communications network qualities prior to providing the 
test input to the voice portal. 

7. (Currently amended) A computer-readable storage medium encoded with instructions 
which, when executed by a computer, cause the computer to perform a method of evaluating 
grammars associated with a voice portal, the method comprising: 

generating, for a current grammar of the voice portal representing a valid input for a first 
menu of the voice portal, a test input, the test input for the current grammar including a test pattern; 
providing the test input to the voice portal; 
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receiving at least one measure of how distinguishable the current grammar is from other 
grammars of a set of active grammars that are active when the current grammar is active, the set of 
active grammars including the current grammar and at least one grammar from a second menu of 
the voice portal, the at least one measure based at least in part on analysis of the test pattern with 
respect to the set of active grammars , the at least one measure comprising at least one measure of 
how distinguishable the current grammar is from the at least one grammar from the second menu of 
the voice portal ; and 

determining whether to modify the current grammar based at least in part on the at least one 
measure. 

8. (Previously presented) The computer-readable storage medium of claim 7, wherein the at 
least one measure of how distinguishable the current grammar is from other grammars of the set of 
active grammars includes a confidence level and a set of n-best results for the test input, and 
wherein the method further comprises comparing the confidence level and set of n-best results for 
the test input with an expected value to assess the at least one measure of how distinguishable the 
current grammar is from other grammars of the set of active grammars. 

9. (Previously presented) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the current grammar to create a modified grammar if the at 
least one measure indicates that the current grammar is not sufficiently distinguishable from the 
other grammars of the set of active grammars. 

10. (Previously presented) The computer-readable storage medium of claim 9, wherein the 
method further comprises: 

(i) generating a test input for the modified grammar, the test input including a test pattern 
for the modified grammar; 

(ii) providing the test input for the modified grammar to the voice portal; 

(iii) receiving at least one measure of how distinguishable the modified grammar is from 
other grammars of a set of active grammars that are active when the modified grammar is active, the 
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modified grammar being one grammar of the set of active grammars that are active when the 
modified grammar is active; and 

(iv) modifying the modified grammar and repeating steps (i) through (iii) until the at least 
one measure of how distinguishable the modified grammar is from other grammars of the set of 
active grammars that are active when the modified grammar is active indicates that the modified 
grammar is sufficiently distinguishable from the other grammars of the set of active grammars that 
are active when the modified grammar is active. 

1 1 . (Previously presented) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the test pattern to emulate one or more user voices prior to 
providing the test input to the voice portal. 

12. (Previously presented) The computer-readable storage medium of claim 7, wherein the 
method further comprises modifying the test pattern to emulate the influence of one or more 
communications network qualities prior to providing the test input to the voice portal. 

1 3 . (Currently amended) A system for evaluating grammars of a voice portal executing on a 
portal server, the system comprising: 

an analysis interface for extracting a current grammar from a set of active grammars of the 
voice portal, the current grammar representing a valid input for a first menu of the voice portal and 
being one grammar of the set of active grammars, the set of active grammars including at least one 
grammar from a second menu of the voice portal; 

a test pattern generator for generating a test input for the current grammar, the test input 
including a test pattern; 

a text-to-speech engine on a computer for entering the test input into the voice portal; 

a results collector for analyzing the test input entered into the voice portal against the set of 
active grammars; and 

a results analyzer for deriving a set of statistics indicative of how distinguishable the current 
grammar is from other grammars of the set of active grammars , the set of statistics being indicative 
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of how distinguishable the current grammar is from the at least one grammar from the second menu 
of the voice portal . 

14. (Previously presented) The system of claim 13, wherein the set of statistics includes a 
confidence level and a set of n-best results for the test input, and wherein the results analyzer is 
configured to compare the confidence level and set of n-best results for the test input with an 
expected value to assess how distinguishable the current grammar is from other grammars of the set 
of active grammars. 

1 5 . (Previously presented) The system of claim 13, wherein the test pattern generator is 
configured to modify the test pattern to emulate one or more user voices prior to entering the test 
input into the voice portal. 

1 6. (Previously presented) The system of claim 13, wherein the test pattern generator is 
configured to modify the test pattern to emulate the influence of one or more communications 
network qualities prior to entering the test input into the voice portal. 

17. (Cancelled) 
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